Adaptive Risk Bounds in Unimodal Regression
نویسندگان
چکیده
We study the statistical properties of the least squares estimator in unimodal sequence estimation. Although closely related to isotonic regression, unimodal regression has not been as extensively studied. We show that the unimodal least squares estimator is adaptive in the sense that the risk scales as a function of the number of values in the true underlying sequence. Such adaptivity properties have been shown for isotonic regression by Chatterjee et al. (2015b) and Bellec (2016). A technical complication in unimodal regression is the nonconvexity of the underlying parameter space. We develop a general variational representation of the risk that holds whenever the parameter space can be expressed as a finite union of convex sets, using techniques that may be of interest in other settings.
منابع مشابه
Polyshrink: An Adaptive Variable Selection Procedure That Is Competitive with Bayes Experts
We propose an adaptive shrinkage estimator for use in regression problems charaterized by many predictors, such as wavelet estimation. Adaptive estimators perform well over a variety of circumstances, such as regression models in which few, some or many coefficients are zero. Our estimator, PolyShrink, adaptively varies the amount of shrinkage to suit the estimation task. Whereas hard threshold...
متن کاملAdaptive Variable Selection with Bayesian Oracles
We analyze the performance of adaptive variable selection with the aid of a Bayesian oracle. A Bayesian oracle supplies the statistician with a distribution for the unknown model parameters, here the coefficients in an orthonormal regression. We derive lower bounds for the predictive risk of regression models constructed with the aid of a class of Bayesian oracles, those that are unimodal and s...
متن کاملOn discrete a-unimodal and a-monotone distributions
Unimodality is one of the building structures of distributions that like skewness, kurtosis and symmetry is visible in the shape of a function. Comparing two different distributions, can be a very difficult task. But if both the distributions are of the same types, for example both are unimodal, for comparison we may just compare the modes, dispersions and skewness. So, the concept of unimodali...
متن کاملMargin Adaptive Risk Bounds for Classification Trees
Margin adaptive risk bounds for Classification and Regression Trees (CART, Breiman et. al. 1984) classifiers are obtained in the binary supervised classification framework. These risk bounds are obtained conditionally on the construction of the maximal deep binary tree and permit to prove that the linear penalty used in the CART pruning algorithm is valid under margin condition. It is also show...
متن کاملPhysical Measures for Infinitely Renormalizable Lorenz Maps
A physical measure on the attractor of a system describes the statistical behavior of typical orbits. An example occurs in unimodal dynamics. Namely, all infinitely renormalizable unimodal maps have a physical measure. For Lorenz dynamics, even in the simple case of infinitely renormalizable systems, the existence of physical measures is more delicate. In this article we construct examples of i...
متن کامل